The Complexity of 
Mean-Payoff Automaton Expression 



Yaron Velner 

The Blavatnik School of Computer Science, Tel Aviv University, Israel 



Abstract. Quantitative languages are extension of Boolean languages 
that assign to each word a real number. With quantitative languages, 
systems and specifications can be formalized more accurately. For exam- 
ple, a system may use a varying amount of some resource (e.g., memory 
consumption, or power consumption) depending on its behavior, and a 
specification may assign a maximal amount of available resource to each 
behavior, or fix the long-run average available use of the resource. 
Mean-payoff automata are finite automata with numerical weights on 
transitions that assign to each infinite path the long-run average of the 
transition weights. Mean-payoff automata forms a class of quantitative 
languages that is not robust, since it is not closed under the basic alge- 
braic operations: min, max, sum and numerical complement. The class 
of mean-payoff automaton expressions, recently introduced by Chatterjee 
et al., is currently the only known class of quantitative languages that 
is robust, expressive and decidable. This class is defined as the closure 
of mean-payoff automata under the basic algebraic operations. In this 
work, we prove that all the classical decision problems for mean-payoff 
expressions are PSPACE-complete. Our proof improves the previously 
known 4EXPTIME upper bound. In addition, our proof is significantly 
simpler, and fully accessible to the automata-theoretic community. 

1 Introduction 

In algorithmic verification of reactive systems, the system is modeled as a finite- 
state transition system, and requirements are captured as languages of infinite 
words over system observations |15II17) . The classical verification framework only 
captures qualitative aspects of system behavior, and in order to describe quanti- 
tative aspects, for example, consumption of resources such as CPU and energy, 
the framework of quantitative languages was proposed [5] . 

Quantitative languages are a natural generalization of Boolean languages 
that assign to every word a real number instead of a Boolean value. With such 
languages, quantitative specifications can be formalized. In this model, an im- 
plementation La satisfies (or refines) a specification Lb if La(w) < Lb(w) for 
all words w. 

This notion of refinement is a quantitative generalization of language inclu- 
sion, and it can be used to check for example if for each behavior, the long-run 
average response time of the system lies below the specified average response re- 
quirement. The other classical decision problems such as emptiness, universality, 
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and language equivalence have also a natural quantitative extension. For exam- 
ple, the quantitative emptiness problem asks, given a quantitative language L and 
a rational threshold v, whether there exists some word w such that L(w) > v, 
and the quantitative universality problem asks whether L(w) > v for all words 
w. We also consider the notion of distance between two quantitative languages 
La and Lb, defined as sup^g^v \La(w) — Lb(w)\. 

The model of mean-payoff automaton is a popular approach to express quan- 
titative properties; in this model, a payoff (or a weight) is associated with each 
transition of the automaton, the mean-payoff of a finite run is simply the average 
of the payoff of the transitions in the run, and the mean-payoff of an infinite run 
is the limit, as the length of the run tends to infinity. 

In this work, we study the computational complexity of the classical decision 
problems for the class of quantitative languages that are defined by mean-payoff 
expression. An expression is either a deterministic^ mean-payoff automaton, or 
it is the max, min or sum of two mean-payoff expressions. This class, introduced 
in [4], is robust as it is closed under the max, min, sum and the numerical 
complement operators g]. 

The decidability of the classical decision problems, as well as the computabil- 
ity of the distance problem, was first established in [3] ; in this paper we describe 
alternative proofs for these results. Our proofs offer the following advantages: 
First, the proofs yield PSPACE complexity upper bounds, which match corre- 
sponding PSPACE lower bounds; in comparison to 4EXPTIME upper bounds 
achieved in g]. Second, our proofs reside only in the frameworks of graph theory 
and basic linear-programing, which are common practices among the automata- 
theoretic community, whereas a substantial part of the proofs in [4 resides in 
the framework of computational geometry. 

Our proofs are based on a reduction from the emptiness problem to the 
feasibility problem for a set of linear inequalities; for this purpose, inspired by 
the proofs in [19) . we establish a connection between the emptiness problem 
and the problem of finding a multi-set of cycles, with certain properties, in a 
directed graph. The reduction also reveals how to compute the maximum value 
of an expression, and therefore the decidability of all mentioned problems is 
followed almost immediately. 

This paper is organized as follows: In the next section we formally define the 
class of mean-payoff expressions; in Section [3] we describe a PSPACE algorithm 
that computes the maximum value of an expression that does not contain the 
max operator; in Section @] we show PSPACE algorithm for all the classical 
problems and prove their corresponding PSPACE lower bounds. Due to lack of 
space, in some cases the proofs are omitted, and in other cases only sketches of 
the proofs are presented. The full proofs are given in the appendix. 



1 We note that the restriction to deterministic automata is inherent; for nondetermin- 
istic automata all the decision problems are undecidable [J. 
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2 Mean-Payoff Automaton Expression 

In this section we present the definitions of mean-payoff expressions from pQ. 

Quantitative languages. A quantitative language L over a finite alphabet E is 
a function L : S u — > R. Given two quantitative languages L\ and Li over S, we 
denote by max(Li,L2) (resp., min(Li,L2), sum(Li, L 2 ) and — £1) the quantita- 
tive language that assigns max(Li(w), L,2(w)) (resp., min(Li(n;), £2(10)), L±(w)+ 
L 2 (w), and — Lx(w)) to each word w £ X 1 ". The quantitative language — L is 
called the complement of L. 

Cut-point languages. Let L be a quantitative language over 17. Given a 
threshold v £ R, the cut-point language defined by (L, v) is the language L- v = 
{w £ E u \L(w) > u). 

Weighted automata. A (deterministic) weighted automaton is a tuple A = 
{Q, qi, S, 5, wt}, where (i) Q is a finite set of states, qj £ Q is the initial state, 
and S is a finite alphabet; (ii) SCQxExQ is & set of transitions such that 
for every q £ Q and er € the size of the set {q 1 £ Q\(q, cr, q') £ 8} is exactly 1; 
and (hi) wt : 6 — > Q is a weight function, where Q is the set of rationals. 

The product of weighted automata. The product of the weighted automata 
A\, . . . , A n such that = {Qi, q\, S, 5i, wti) is the multidimensional weighted 
automaton A = A\ X • • • X A n = (Qi x • • • x Q n , (qj,.. . , qf), S, 5, wt) such that 
t = {{qi,---,q n ),o-,(q' x ,...,q' n )) € 5 if tj = (ft,cr,q-) € ^ for all i G {l,...,n}, 
and = (wii(ti), . . . , wt n (t n )) 6 Q n . We denote by A the projection of the 

automaton .4 to dimension i. 

Words and runs. A word w € Z 1 " is an infinite sequence of letters from S. A 
run of a weighted automaton 4 over an infinite word w = cr\o~% . . . is the (unique) 
infinite sequence r = q§o-\q\Oi . . . of states and letters such that q = qi, and 
(qi, <7j_|_i, Qi+i) £ S for all i > 0. We denote by wt(w) — wt(r) — vqVi . . . the 
sequence of weights that occur in r where w, = wt(qi, Ci+i, 9i+i) for all i > 0. 

Quantitative language of mean-payoff automata. The mean-payoff value 
(or limit average) of a sequence w = wo w i • ■ • of real numbers is either 
LimInfAvg(v) = lhninf n _ i . 00 i • X^=o or LimSupAvg(v) = limsup,^^ i • 
^"^p 1 Vi. The quantitative language A of a weighted automaton A is defined by 
A(w) = LimInfAvg(wt(w)); analogously the quantitative language A is defined 
by A(w) = LimSupAvg (wt(w)) . In the sequel we also refer to the quantitative 
language A as the LimlnfAvg automaton A, and analogously the LimSupAvg 
automaton A is the quantitative language A. 

Mean-payoff automaton expressions. A mean-payoff automaton expression 
E is obtained by the following grammar rule: 

E ::= A\A\ m&x(E, E)\mm(E, E)\ sum(£, E) 

where A is a deterministic (one-dimensional) weighted automaton. The quanti- 
tative language Le of a mean-payoff automaton expression E is Le — A (resp., 
L E = A) if E = A (resp., if E = A), and L E = op(L El ,L E2 ) if E = op(E 1 ,E 2 ) 
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for op G {max, min, sum}. We shall, by convenient abuse of notation, inter- 
changeably use E to denote both the expression and the quantitative language 
of the expression (that is, E will also denote Le)- An expression E is called an 
atomic expression if E = A or E = A, where A is a weighted automaton. 

It was established in [3] (and it follows almost immediately by the construc- 
tion of the class) that the class of mean-payoff automaton expressions is closed 
under max, min, sum and numerical complement. 

Decision problems and distance. We consider the following classical decision 
problems for a quantitative language defined by a mean-payoff expression. Given 
a quantitative language L and a threshold v G Q, the quantitative emptiness 
problem asks whether there exists a word w G S u such that L(w) > v, and the 
quantitative universality problem asks whether L(w) > v for all words w G S u . 

Given two quantitative languages L\ and L2, the quantitative language- 
inclusion problem asks whether Li(w) < L 2(111) for all words w € Z7 U ', and 
the quantitative language-equivalence problem asks whether Li(w) = L2(w) for 
all words w G S u . Finally, the distance between L\ and L2 is -D sup (Li, L2) = 
su Pm££" l-^i ( ul ) — ^2(^)1 ; and the corresponding computation problem is to 
compute the value of the distance. 

Maximum value of expression. Given an expression E, its supremum value is 
the real number sup^g^ E(w). While it is obvious that such supremum exists, it 
was proved in [3] that a maximum value also exists (that is, there exists w' G S u 
s.t E(w') = sup^g^ E(w)). Hence the maximum value of the expression E is 
sup^g^ E(w) or equivalently max m£ ^ E(w). 

Encoding of expressions and numbers. An expression E is encoded by the 
tuple ((E), (Ai), . . . , (Ak)), where (E) is the expression string and Ai, ...,Ak 
are the weighted automata that occur in the expression, w.l.o.g we assume that 
each automaton occur only once. A rational number is encoded as a pair of 
integers, where every integer is encoded in binary. 

3 PSPACE Algorithm for Computing the Maximum 
Value of max-free Expressions 

In this section we consider only max-free expressions, which are expressions that 
contain only the min and sum operators. We will present a PSPACE algorithm 
that computes the maximum value of such expressions; computing the maximum 
value amounts to computing the maximum threshold for which the expression 
is nonempty; for this purpose we present four intermediate problems (and so- 
lutions), each problem is presented in a corresponding subsection below. The 
first problem asks whether an intersection of cut-point languages of LimSupAvg 
automata is empty; the second problem asks the same question for LimlnfAvg 
automata; the third problem asks if an arbitrary intersection of cut-point lan- 
guages of LimSupAvg and LimlnfAvg automata is empty; and the last problem 
asks whether a max-free expression is empty. We will first present a naive solu- 
tion for these problems; the solution basically lists all the simple cycles in the 
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product automaton of the automata that occur in the expression; it then con- 
structs linear constraints, with coefficients that depend on the weight vectors of 
the simple cycles, which their feasibility corresponds to the non-emptiness of the 
expression. 

In the fifth subsection we will analyze the solution for the max-free emptiness 
problem; we will show a PSPACE algorithm that solves the problem; and we will 
bound the number of bits that are needed to encode the maximum threshold 
for which the expression is nonempty (recall that such maximal threshold is 
the maximum value of the expression); this will yield a PSPACE algorithm for 
computing the maximum value of a max-free expression. 

In subsections I3.HI3.4I we shall assume w.l.o.g that the product automaton 
of all the automata that occur in the expression is a strongly connected graph; 
this can be done since in these subsections we do not refer to the complexity of 
the presented procedures. 

3.1 The emptiness problem for intersection of LimSupAvg automata 

In this subsection we consider the problem where k weighted automata Ay,..., 
and a rational threshold vector r = (ri, . . . ,Tk) are given, and we need to de- 
cide whether there exists an infinite word w G S u such that Ai(w) > for all 

i G {I, . . . , fc}; equivalently, whether the intersection P)i=i Ai~ r ' is nonempty. 

Informally, we prove that there is such w iff for every i G {1, . . . , k}, there is 
a word Wi such that Ai(wi) > ri. 

Formally, let A = A\ x • • • x At be the product automaton of the automata 
Ax, . . . ,Ak- Recall that an infinite word corresponds to an infinite path in A, 
and that w.l.o.g we assume that the graph of A is strongly connected. Let 
Ci , C*2 , . . . , C n be the simple cycles that occur in A. The next lemma claims 
that it is enough to find one cycle with average weight for every dimension i. 

Lemma 1 There exists an infinite path n in A such that Ai(jr) > ri, for all 
i G {I , . . . , k}, iff for every i G {1, . . . , k} there exists a simple cycle Ci in A, 
with average weight at least ri 

Proof. The direction from left to right is easy: Since for every i G {I, . . . ,k} 
there exists a path iii (namely n) such that Aj(7Tj) > ri it follows that there 
exists a simple cycle in A with average at least in dimension i. (This fact is 
well-known for one-dimensional weighted automata, e.g., see [20., and hence it 
is true for the projection of A to the i-th dimension.) 

For the converse direction, we assume that for every i G {!,..., k} there 
exists a simple cycle Ci in A with average weight at least r.;. Informally, we 
form the path it by following the edges of the cycle Ci until the average weight 
in dimension i is sufficiently close to r^, and then we do likewise for dimension 
I + (i (mod k)), and so on. (Full proof is given in the appendix.) □ 

Lemma Q] shows that the emptiness problem for intersection of LimSupAvg au- 
tomata can be naively solved by an exponential time algorithm that constructs 
the product automaton and checks if the desired cycles exist. 
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3.2 The emptiness problem for intersection of LimlnfAvg automata 

In this subsection we consider the problem where k weighted automata Ai , . . . , A% 
and a rational threshold vector r = (ri, . . . , rk) are given, and we need to de- 
cide whether there exists an infinite word w E S w such that Ai(w) > r, for all 

i E {1, . . . , fc} ;or equivalently, whether the intersection f\_i Ai~ Ti is nonempty. 

For LimlnfAvg automata, the componentwise technique we presented in the 
previous subsection will not work; to solve the emptiness problem for the inter- 
section of such automata we need the notion of r multi-cycles. 

r multi-cycles. Let G be a directed graph equipped with a multidimensional 
weight function wt : E — > Q fc , and let r be a vector of rationals. A multi-cycle is a 
multi-set of simple cycles; the length of a multi-cycle C = {C\, . . . , C n }, denoted 
by \C\, is Y^i=i | | - A multi-cycle C = {C±, . . . , C„} is said to be an r multi-cycle 
if W\ Ei=i w t(Cj) > r, that is, if the average weight of the multi-cycle, in every 
dimension i, is at least r^. 

In the sequel we will establish a connection between the problem of finding an 
r multi-cycle and the emptiness problem for intersection of LimlnfAvg automata. 

A polynomial time algorithm that decides if an r multi-cycle exists is 
known [12] ; in this work however, it is sufficient to present the naive way for 
finding such multi-cycles; for this purpose we construct the following set of lin- 
ear constraints: Let C denote the set of all simple cycles in A; for every c E C 
we define a variable A c ; we define the r multi-cycle constraints to be: 

I] ceC X cWt{c) > r ; Y,cec \ c \ X c = 1 > and for evei T c E C: A c > 

In the next lemma we establish the connection between the feasibility of the r 
multi-cycle constraints and the existence of an f multi-cycle. 

Lemma 2 The automaton A has an r multi- cycle iff the corresponding r multi- 
cycle constraints are feasible. 

Proof. The direction from left to right is immediate, indeed if we define X c as 
the number of occurrences of cycle c in the witness r multi-cycle divided by the 
length of that multi-cycle, then we get a solution for the set of constraints. 

In order to prove the converse direction, it is enough to notice that if the 
constraints are feasible then they have a rational solution. Let X be such rational 
solution, and let N be the least common multiple of all the denominators of the 
elements of A; by definition, the multi-set that contains NX C copies of the cycle 
c is an r multi-cycle. □ 

In the following lemma we establish a connection between the problem of 
finding an r multi-cycle and the emptiness problem for intersection of LimlnfAvg 
automata. 

Lemma 3 There exists an infinite path it in A such that Ai(jr) > ri, for all 
i E {!,..., k}, iff the graph of A contains anr = (ri,.. multi-cycle. 
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Proof. To prove the direction from right to left, we show, in the following lemma, 
that if an r multi-cycle does not exist, then for every infinite path there is a 
dimension i for which Ai(jr) < fj. 

Lemma 4 Let G = (V, E) be a directed graph equipped with a weight function 
wt : E — > Q k , and let r S Q k be a threshold vector. If G does not have an r 
multi-cycle, then there exist constants ec > and ma G N such that for every 
finite path ir there is a dimension i for which wti(ir) < ma + (r* — ec) |7r| . 

Lemma 2] implies that if an r multi-cycle does not exists, then for every infinite 
path 7r there exist a dimension i and an infinite sequence of indices j\ < j% < 
js . . . such that the average weight of the prefix of n, of length j m , is at most 
r.i — for all m £ N. Hence by definition LimlnfAvg .^tt) < r*j. 

In order to prove the converse direction, let us assume that G has an r multi- 
cycle C = C\, . . . , C n , such that the cycle Ci occurs n%i times in C. We obtain 
the witness path ir in the following way (we demonstrate the claim for n = 2): 
let 7Ti2 be a path from C\ to Ci and 7r 2 i be a path from C2 to C\ (recall that 
the graph is strongly connected), we define 

TT = C 1 ir 12 C 2 TT21(G 1 ) 7Tl 2 (C 2 J TT 2 1...(C 1 j7ri 2 (C 2 J 7T 2 l . . . 

Informally, the long-run average weight of the path it is determined only by the 
cycles C™ 1 and C™ 2 , since the effect of the paths 7Ti 2 and 7r 2 i on the average 
weight of a prefix of ir becomes negligible as the length of the prefix tends to 
infinity. Thus Ai(jr) > r, for every dimension i, which concludes the proof of 
Lemma [3] □ 

Lemma [3] and Lemma [2] immediately give us the following naive algorithm 
for the emptiness problem for intersection of LimlnfAvg automata: First, con- 
struct the product automaton; second, list all the simple cycles in the product 
automaton; third, construct the r multi-cycle constraints and check for their 
feasibility. 

When the automata and the threshold vector are clear from the context, 
we shall refer to the r multi-cycle constraints, which are constructed from the 
intersection of the given LimlnfAvg automata and the threshold r, as the lim-inf 
constraints. 

3.3 The emptiness problem for intersection of LimSupAvg and 
LimlnfAvg automata 

In this subsection we consider the problem where 2k weighted automata 
Ai, . . . , Afc, Bi, ... , -Bfc and two fc-dimensional rational threshold vectors r° and 
r b are given, and we need to decide whether there exists an infinite word w S S u 
such that Aj(w) > rf and Bi(w) > r\ for all i £ {l,...,fc}; or equivalently, 

whether the intersection (HiLi A^ Ti ) n (Hi=i Bi~ r ' ) is nonempty. 

Our solution will be a result of the following two lemmata. The first lemma 
claims that there is a word that satisfies all the conditions iff there are words 
w\ , . . . , Wk such that Wj satisfies all the lim-inf conditions and the lim-sup con- 
dition for the automaton Bj. 
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Lemma 5 There exists an infinite word w for which Ai (w) > rf and Bi (w) > r\ 
for all i £ {1, . . . , k} iff there exist k infinite words W\, W2, ■ ■ ■ Wk such that for 
every j £ {1, . . . , fc}: 

Aiiwj) > rf for alii £ {1, . . ., k} ; and Bj(wj) > r b } 

The second lemma shows that the emptiness problem for an intersection of 
lim-inf automata and one lim-sup automaton can be reduced to the emptiness 
problem for an intersection of lim-inf automata. 

Lemma 6 The intersection B\~ 1 n (Hi=i ^%~ Ti ) * s nonempty iff the intersec- 
tion Bi~ ri n (Hi=i Ai- ri ) is nonempty. 

Due to Lemma [5] and [6] we can solve the emptiness problem for intersection 
of lim-inf and lim-sup automata in the following way: First, we construct the 
product automata A 1 = A\ x • • • x x Bi for all i £ {1, . . . , k} and list all 
the simple cycles that occur in it; second, we construct the threshold vector 
r l = (rf, . . . , ri, rf) and check if the graph of A 1 has an r l multi-cycle, for all 
i e {1, . . . , fc}. Due to Lemma [S] and [B] the intersection is nonempty iff every A 1 
has an r l multi-cycle, that is, if the r l multi-cycle constraints are feasible. 

Recall that the existence of an r l multi-cycle in the graph of A 1 is equivalent 
to the feasibility of the corresponding lim-inf constraints for A 1 and r % ; in the se- 
quel, we will refer to the set of constraints (Ji=i {lim-inf constraints for A 1 and r 1 } 
as the min- only constraints. (As we use them to decide the emptiness of expres- 
sions that contain only the min operator.) 

In this subsection we proved that the emptiness of the intersection of 
LimlnfAvg and LimSupAvg automata is equivalent to the feasibility of the cor- 
responding min-only constraints. 

3.4 The emptiness problem for max-free expressions 

In this subsection we solve the emptiness problem for max-free expressions. The 
solution we present is a reduction to the emptiness problem for an intersection of 
lim-inf and lim-sup automata with a threshold vector that satisfies certain linear 
constraints; the reduction yields a naive double-exponential complexity upper- 
bound for the problem, which we will improve in the succeeding subsection. 
The reduction is based on the next simple observation. 

Observation 1 The expression E = E\ + E2 is nonempty with respect to the 
rational threshold v iff there exist two thresholds ^1,^2 £ K such that (i) The 
intersection of the cut-point languages E^ Ul and E^ 2 is nonempty; and (ii) v\-\- 
v 2 > v. 

If E = Ei + E<x and E\ and E2 are min-only expressions then we decide the 
emptiness of E in the following way: we combine the min-only constraints for the 
expressions E\ and Ei with respect to arbitrary thresholds n and r 2 (that is, T\ 
and T2 are variables in the constraints), note that these are still linear constraints; 
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we then check the feasibility of the constraints subject to r-y + r 2 > v. (Note that 
as all the constraints are linear, this can be done by linear programming.) 

The next lemma shows that in the general case, the emptiness problem for 
an arbitrary max-free expression and a threshold v can be reduced, in polyno- 
mial time, to the emptiness problem for an intersection of lim-inf and lim-sup 
automata with respect to threshold vectors r a and r b subject to certain linear 
constraints on r a and r b . 

Lemma 7 Let E be a max-free expression with atomic expressions e\,...,ek, 
and let v be a rational threshold, then there exist a 2k x 2k matrix Me and a 2k- 
dimensional vector b v , with rational coefficients, and computable in polynomial 
time (from E and v ) such that: 

The expression E is nonempty (with respect to v) iff there exists a 2k- 
dimensional vector of reals r such that the intersection |"L=i e f Tz * s 
nonempty and Me xr>b u . 

Instead of formally proving the correctness of Lemma [JJ we provide a generic 
example that illustrates the construction of the matrix Me and the vector b v . 

Example 1 Let E = min( A± , (A2 + A 3 )) + min(A 4 ,.A5). Then for every veR, 
each the following condition is equivalent to E- u ^ 0. 

- 3r 6 , r 7 £ R such that L- r& , „ . „ — — Pi L~ r7 — „ , ^ and r e + r 7 > v. 

min(Ai,(A2+A 3 )) Biin( A4, , A5 ) ' u 1 _ 

- 3ri,r 4 ,r 5 ,r 6 ,r 7 ,r 8 such that A x - ri n L^ r ^_ n A~/^ Ti fl A 5 - r5 yt and 
r\ > r6, r s > r e , r 4 > r 7 , r 5 > r 7 and r e + r 7 > v. 

- 3ri,r2,r 3 ,r4,r 5 ,r 6 ,r 7 ,r 8 such that ^- ri nA 1 - r2 nA^- r3 nM- r4 nA 1 - r5 ^0 
and n > re, r 2 + r 3 > r 8 , r% > r 6 , r 4 > r 7 , r 5 > r 7 and r 6 + r 7 > v. 

The reader should note that we associate every variable ri either with a sub- 
expression or with an atomic expression; as we assume that each atomic expres- 
sion occurs only once, the number of variables is at most 2k. 

Hence we can solve the emptiness problem for a rational threshold v and a 
max-free expression E, which contains the atomic expressions e±, . . . , in the 
following way: First, we construct the matrix Me and the vector 6„; second, we 
construct the min-only constraints for the intersection |~L_i e ^ r * an< ^ check for 
their feasibility subject to the constraints Me x r >b u . 

In the sequel we will refer to the min-only constraints along with the M e,u x 
r > b v constraints as the max-free constraints; we will show that even though 
the size of the constraints is double-exponential, there is a PSPACE algorithm 
that decides their feasibility (when the input is E and v). 

3.5 PSPACE algorithm for the emptiness problem of max-free 
expressions 

In this subsection we will present a PSPACE algorithm that for given max-free 
expression E and rational threshold v, decides the feasibility of the max-free 
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constraints; as shown in subsection !3.4[ such algorithm also solves the emptiness 
problem for max-free expressions. Informally, we will show that if the max- 
free constraints are feasible then they have a short solution, and that a short 
solution can be verified by a polynomial-space machine; hence the problem is in 
NPSPACE, and due to Savitch Theorem, also in PSPACE. 

The next lemma describes key properties of max-free constraints, which we 
will use to obtain the PSPACE algorithm. 

Lemma 8 For every max-free expression E: 

1. For every threshold v, the max-free constraints have at most 0{k 2 ) con- 
straints, where k is the number of automata that occur in E, that are not of 
the form of x > 0, where x is a variable. 

2. There exists a bound t, polynomial in the size of the expression, such that for 
every threshold v , the max-free constraints are feasible iff there is a solution 
that assigns a nonzero value to at most t variables. 

3. There exists a bound t, polynomial in the size of the expression, such that the 
maximum threshold for which the max-free constraints are feasible, is 
a rational and can be encoded by at most t bits. (In particular such maximum 
v exists.) 

Recall that a rational solution for the max-free constraints corresponds to vectors 
of thresholds and a set of multi-cycles, each multi-cycle with an average weight 
that matches its corresponding threshold vector; by Lemma the number of 
different simple cycles that occur in the witness multi-cycles set is at most t. We 
also observe that if a multi-set of cycles (that are not necessarily simple) with 
average weight vector v exists, then a v multi-cycle (of simple cycles) also exists, 
since we can decompose every non-simple cycle to a set of simple cycles; thus, a 
V multi-cycle exists iff there exists a multi-set of short cycles, where the length 
of each cycle in the multi-set is at most the number of vertices in the graph (note 
that in particular, every simple cycle is short). 

Hence, we can decide the feasibility of the max-free constraints in the follow- 
ing way: First, we guess t weight vectors of t short cycles that occur in the same 
strongly connected component (SCC) of the product automaton of all the au- 
tomata that occur in the expression; second, we construct the 0{k 2 ) constraints 
of the max-free constraints and assign zero values to all the variables of the non- 
chosen cycles; third, we check the feasibility of the formed 0(k 2 ) constraints, 
where each constraint has at most t + 1 variables. 

Note that we can easily perform the last two steps in polynomial time (as 
the values of the weight vector of every short cycle can be encoded by polyno- 
mial number of bits); hence, to prove the existence of a PSPACE algorithm, it 
is enough to show how to encode (and verify by a polynomial-space machine) t 
average weight vectors of t short cycles that belong to one SCC of the product 
automaton. Informally, the encoding scheme is based on the facts that every 
vertex in the product automaton is a fc-tuple of states, and that a path is a 
sequence of alphabet symbols; the verification is done by simulating the k au- 
tomata in parallel, and since the size of the witness string should be at most 
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exponential, we can do it with a polynomial-size tape. (More details are given 
in the appendix.) 

To conclude, we proved that there is a PSPACE algorithm that decides the 
feasibly of the max- free constraints, and therefore the next lemma follows. 

Lemma 9 The emptiness problem for max-/ree expressions is in PSPACE. 

Lemma[9]along with Lemma|8][3) imply a PSPACE algorithm that computes 
the maximum value of a max-free expression; the next lemma formally states 
this claim. 

Lemma 10 (i) The maximum value of a max-free expression is a rational value 
that can be encoded by polynomial number of bits ( in particular, every expression 
has a maximum value); and (ii) The maximum value of a max-free expression 
is PSPACE computable. 

4 The Complexity of Mean-Payoff Expression Problems 

In this section we will prove PSPACE membership, and PSPACE hardness, for 
the classical mean-payoff expression problems; the key step in the proof of the 
PSPACE membership is the next theorem, which extends Lemma[T0]to arbitrary 
expressions (as opposed to only max-free expressions). 

Theorem 1 (i) The maximum value of an expression is a rational value that 
can be encoded by polynomial number of bits ( in particular, every expression has 
a maximum value); and (ii) The maximum value of an expression is PSPACE 
computable. 

Proof ( of Theorem]!^. Informally, we prove that if the number of max operators 
in the expression E is m > 0, then we can construct in linear time two expressions 
E\ and E2, each with at most m — 1 max operators and of size at most \E\, such 
that E = max(i?i, E2); hence, in order to compute the maximum value of E, we 
recursively compute the maximum values of E\ and E2 , and return the maximum 
of the two values; note that if the expression is max-free (that is, if m — 0), then 
thanks to Lemma [TU1 the maximum value is PSPACE computable and can be 
encoded by polynomial number of bits. (Formal proof is given in the appendix.) 

□ 

The PSPACE membership of the classical problems follows almost trivially from 
Theorem Q] Indeed, for a given threshold, an expression is empty if its maximum 
value is less than the threshold, and an expression is universal if its minimum 
value (that is, the maximum of its numerical complement) is not less than the 
threshold; the language inclusion and equivalence problems are special cases of 
the universality problem (since the class of mean-payoff expressions is closed 
under numerical complement and the sum operator); and the distance of the 
expressions E\ and Ei is the maximum value of the expression F — max(i?i — 
Ei , Ei — E\ ) . 
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The PSPACE lower bounds for the decision problems are obtained by re- 
ductions from the emptiness problem for intersection of regular languages (see 
proofs in the appendix), which is PSPACE- hard [14]. 

Thus, we get the main result of this paper: 

Theorem 2 For the class of mean-payoff automaton expressions, the quanti- 
tative emptiness, universality, language inclusion, and equivalence problems are 
PSPACE- complete, and the distance is PSPACE computable. 

5 Conclusion and Future Work 

We proved tight complexity bounds for all classical decision problems for mean- 
payoff expressions and for the distance computation problem. Future work is 
to investigate the decidability of games with mean-payoff expression winning 
condition. 
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novich for his helpful comments. This research was partially supported by the 
Israeli Centers of Research Excellence (I-CORE) program, (Center No. 4/11). 

References 

1. R. Alur, A. Degorre, O. Maler, and G. Weiss. On omega-languages defined by 
mean-payoff conditions. FOSSACS '09, pages 333-347. Springer- Verlag, 2009. 

2. M. Bojanczyk. Beyond omega-regular languages. In STACS, pages 11-16, 2010. 

3. U. Boker, K. Chatterjee, T. A. Henzinger, and O. Kupferman. Temporal specifi- 
cations with accumulative values. In LICS, pages 43-52, 2011. 

4. K. Chatterjee, L. Doyen, H. Edelsbrunner, T. A. Henzinger, and P. Rannou. Mean- 
payoff automaton expressions. In CONCUR, pages 269-283, 2010. 

5. K. Chatterjee, L. Doyen, and T. A. Henzinger. Expressiveness and closure prop- 
erties for quantitative languages. Logical Methods in Computer Science, 2010. 

6. K. Chatterjee, L. Doyen, and T. A. Henzinger. Quantitative languages. ACM 
Trans. Comput. Log., 11(4), 2010. 

7. K. Chatterjee, A. Ghosal, T. A. Henzinger, D. Iercan, C. M. Kirsch, C. Pinello, 
and A. Sangiovanni-Vincentelli. Logical reliability of interacting real-time tasks. 
DATE '08, pages 909-914. ACM. 

8. M. Droste and P. Gastin. Weighted automata and weighted logics. Theor. Comput. 
Sci., pages 69-86, 2007. 

9. M. Droste, W. Kuich, and H. Vogler. Handbook of Weighted Automata. Springer 
Publishing Company, Incorporated, 2009. 

10. M. Droste and D. Kuske. Skew and infinitary formal power series. ICALP'03, 
pages 426-438. Springer- Verlag. 

11. M. Droste and G. Rahonis. Weighted automata and weighted logics on infinite 
words. In Developments in Language Theory, pages 49-58, 2006. 

12. S. Kosaraju and G. Sullivan. Detecting cycles in dynamic graphs in polynomial 
time. STOC, pages 398-406. ACM, 1988. 

13. O. Kupferman and Y. Lustig. Lattice automata. VMCAI'07, pages 199-213. 
Springer- Verlag, 2007. 



The Complexity of Mean-Payoff Automaton Expression 



13 



14. K.J. Lange and P. Rossmanith. The emptiness problem for intersections of regular 
languages. MFCS '92, pages 346-354. Springer- Verlag, 1992. 

15. Z. Manna and A. Pnueli. The temporal logic of reactive and concurrent systems. 
Springer- Verlag New York, Inc., 1992. 

16. K. G. Murty. Linear Programming. Wiley, New York, 1983. 

17. A. Pnueli. The temporal logic of programs. In FOCS, pages 46-57, 1977. 

18. Y. Velner. The complexity of mean-payoff automaton expression. CoRR, 
abs/1106.3054, 2012. 

19. Y. Velner and A. Rabinovich. Church synthesis problem for noisy input. In FOS- 
SACS, pages 275-289, 2011. 

20. U. Zwick and M. Paterson. The complexity of mean payoff games on graphs. Theor. 
Comput. Set., 158(l&2):343-359, 1996. 



14 Yaron Velner 



Appendix 

A Proofs for Section [3] 

A.l Proofs for subsection 13.11 
Proof of Lemma [1] 

Proof. The direction from left to right is easy: 

Since for every i G {1, . . . , k} there exists a path Tti (namely it) such that 
Ai(ni) > Ti it follows that there exists a simple cycle in A with average weight 
at least r, in dimension i. (This fact is well-known for one-dimensional weighted 
automata (e.g., see [10]), and hence it is true for the projection of A to the i-th 
dimension.) 

For the converse direction, we assume that for every i G {1, ...,k} there 
exists a simple cycles Ci in A with average weight at least r^. Informally, we 
form the path it by following the edges of the cycle Ci until the average weight 
in dimension i is sufficiently close to r^, and then we do likewise for dimension 
1 + (i (mod fc)), and so on. Formally, for every e > 0, and an arbitrary finite 
path A in A, we construct the path 7r e (A) in the following way: The first part 
of the path is A, then we continue to a vertex in the cycle C\ and follow the 
edges of the cycle C\ until the average weight in the first dimension of the path 
is at least r\ — e; we then continue to a vertex in Ci and follow the edges of Ci 
until the average weight in the second dimension is at least ri — e; we repeat the 
process also for C3, . . . , Ck- We recall that A is strongly connected, and therefore 
7T e (A) is a valid path. Note that for every i G {1, . . . , k} there is a prefix of 7r e (A) 
with average weight at least — e in dimension i. Let ir° be an arbitrary path, 
let £i = and let n 1 = 7r ei (7r l_1 ). The reader can verify that the infinite path 
7r = -K a -K 1 i{ 1 . . . satisfies Ai(n) > ri for every i E {1, . . . , k}, which concludes the 
proof of the lemma. □ 

A. 2 Proofs for subsection 13.21 
Proof of Lemma [3] 

Proof. To prove the direction from right to left, we show, in the following lemma, 
that if an r multi-cycle does not exist, then for every infinite path there is a 
dimension i such that Ai(n) < ri. 

Lemma 11 Let G = (V,E) be a directed graph equipped with a weight function 
wt : E —> and let r G Q fc be a threshold vector. If G does not have an r 
multi-cycle, then there exist constants cq > and rriQ G N such that for every 
finite path tt there is a dimension i for which wti(ir) < ma + (r< — e(j)|7r|. 

Proof. Let ec be the minimal e for which the r — e multi-cycle constraints are 
feasible; note that is the optimal solution for a linear programming problem; 
the constraints of the linear programming problem are feasible, since the r — e 
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multi-cycle constraints are feasible for e = 2W + max{ri, . . . ,rk} (where W is 
the maximal weight that occur in the graph) ; in addition the solution is bounded 
by e = — W; hence such ec must exist, and if G does not have an f multi-cycle 
then ec > (due to Lemma [2]). 

Let 7r be an arbitrary finite path in G of length longer than |V|, we de- 
compose 7r into three paths namely 7ro,7r c and tt\ such that | tto | , | ^"1 1 < \V\ 
and 7r c is a cyclic path (this can be done since any path longer then \V\ con- 
tains a cycle). Let Ci,...,C„ be the simple cycles that occur in 7r c , and let 
m; be the number of occurrences of cycle Cj in 7r c . By definition we get that 
j^wt(TT c ) — c-iEj=i m i' , ''(Q)i an d | Tic | = Y^j=i m j\^j\- Towards contra- 
diction let us assume that there exists S < cq such that for every dimension 
j^Wi(n c ) > n — S. Hence, by definition the r — S multi-cycle constraints are 
feasible, which contradicts the minimality of ec- 

Therefore, for ttiq — — 2|V|W (where — W is the minimal weight that occur 
in the graph) we get that for every finite path 7r there exists a dimension i for 
which w£j(7r) < ttiq + (r.; — ec?) |tt| • D 

Lemma [4] implies that if an r multi-cycle does not exists, then for every 
infinite path ir there exist a dimension i and an infinite sequence of indices 
ji < J2 < 33 ■ ■ ■ such that the average weight of the prefix of ir of length j m is 
at most Ti — for all m e N. Hence by definition LimlnfAvg ^n) < r^. 

In order to prove the converse direction, let us assume that G has an r multi- 
cycle C — C\, . . . ,C n , such that the cycle Cj occurs rrii times in C. We obtain the 
witness path n, for which we will prove that LimlnfAvgfa) > r, in the following 
way: Let Tr^j be a path from the cycle Ci to the cycle Cj (recall that the graph 
is strongly connected). For every index I € N we define the finite path to be 

We set 7r = ir 1 ^ 2 . . . tt 1 . . . , and claim that LimlnfAvg ^(n) is at least r$ in every 
dimension i; for this purpose, it is enough to prove that for every e > we 
have LimlnfAvg^ir) > r*j — e. For the rest of the proof we shall assume w.l.o.g 
that Ti = 0. Let us denote by ttj the finite path ir 1 !? 2 . . . t: 3 ; by P the sum 

Ki->2 1 + 1 1- Ki->i+i| + | h7r„_i^„| + |7r n ^i|; by \C\ the total length of the 

multi-cycle, that is, X)™=i TO i|Cih an< i by —W the minimal weight that occur in 
the graph (in all dimensions). Then the average weight of dimension i for the 
path nj is at least 

-W\P\j (1) 

more over, in the path TTj+i = TijTT 3+1 the average weight in dimension i, for any 
prefix longer than |7Tj| is at least 

-W\P\(j + l)-W(j + l)\C\ 



j-p + \c\YLit 



(2) 



Since the value of the sum J2e=i & ^ s at least we get that for a large enough 
number j e , for any prefix of n that is longer than j e , the average weight in 
dimension i is at least — e, and the claim follows. 
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Thus Ai(ir) > fj for every dimension i, which concludes the proof of Lemma[3] 

□ 

A. 3 Proofs for subsection 13.31 

Proof of Lemma[5] In this proof, w.l.o.g, we assume that both threshold vectors 
are the zero vector (that is, the vector 0). 

The proof for the direction from left to right is trivial. To prove the con- 
verse direction, we denote by A the 2/c-dimensional product automaton of the 
automata A\, . . . , Ak, Bx, ... , B^; recall that an infinite word corresponds to an 
infinite path in A; hence we can assume that there exist infinite paths 7Ti, . . . , 7Tfc 
such that for every j G {1, . . . , k}: 

Mjtj) > for alH G {1, . . . , k} ; and B~{-k 3 ) > 

Informally, we shall construct the witness path 7r, for which Ai(jr) > and 
-8,(71") > for all i G {1, ...,k}, by following the path nj until the average 
weights in the corresponding dimensions of At,... , A^ and Bj are sufficiently 
close to 0, and repeat the process for 1 + j mod fc, and so on. 

Formally: We denote the value of the minimal weight that occur in the graph 
by — W. For every j G {1, . . . , k} and e > we denote by Nj the first position 
in the path ttj such that in every position of 7Tj, that is greater than Nj, the 
average weight in all the dimensions that corresponds to Al, . . . , A/, is at least 
— e; the reader should note that by definition, such Nj always exists; we denote 
N e — maxj G {! k} Nj. For every to G N, e > and a finite path A we denote 
by 7r™' e ' A the shortest prefix of the path A • iTj, of length at least to, such that 
average weights in the prefix, in all the dimensions that correspond to A% , . . . , Ak 
and Bj, are at least — e (note that by the definition of 7Tj, such prefix exists). 
The following remark demonstrate the key property of the definitions above. 

Remark 1 Let X be a finite path, and let M e = - . For every i,j G {1, . . . , k} 

and e > 0, the infinite path ~K i e,e ' TTj satisfies 

In every position of the path, greater than irf Ie,e,x , the average weight in 
the dimensions that correspond to A±, . . . ,Ak is at least —It. 

We define an infinite sequence of finite paths Ao, Ai, A2, . . . , in the following way: 

— Ao is an arbitrary path, for example: the first edge of ~k\ . 

— For i > 0: we denote Ai = A,_i • n i e *' c *' 1-1 , where e, = \ and for i > k: 

""j = (mod fc))- 

We define it to be the limit path of the sequence {\i} c *^ 1 ; by the construction of 
7T it follows that for every e > 0, in infinite many positions, the average weight 
of the dimension that corresponds to Bi is at least — e, and that as of certain 
position, the average weight in all the dimensions that correspond to A\ , . . . , Aj~ 
is at least — e. Hence, by definition, for all i G {1, . . . , k}: 

A(tt) > and B~(n) > 
as required, and the proof of the lemma follows. □ 
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Proof of Lemma [6] 

Proof. The direction from right to left is trivial; to prove the converse direction, 
let us assume that the intersection B\- Tl n (PliLi Ai~ Ti ) is empty, and we shall 

prove that the intersection B\~ 1 n(|~L =1 Ai- Ti ) is also empty. W.l.o.g we assume 

that r a = r b = 0. Let A be the k + 1-dimensional product automaton of the 
automata A±, . . . , Ak and B\. Let 7r be an infinite path in A, we will show that 
either Ai{ir) < for some i £ {l,...,fc} or that -Bi(tt) < 0. We first observe 
that the automaton A does not have a multi-cycle; this fact follows from 
the assumption that the intersection Bi~° n (fliLi^i" ) is empty and from 
Lemma [3] Hence, by Lemma |4j there exist constants m € N and c > such 
that for every prefix it' of the path ir there exists a dimension i for which the 
weight of 7r' in dimension i is at most m — c\ir'\; let j be the corresponding 
dimension of the automaton and let 7r* be the longest prefix with average 
weight at most —% in dimension j (note that 7r* does not necessarily exist). We 
consider two disjoint cases: In the first case, there exists such 7r*, and then, by 
definition Bx(tt) < — % < and the claim follows. In the second case, the path 
7r has infinitely many prefixes with average weight at least — % in dimension j; 
therefore (by Lemma 3]) there must exist a dimension i for which the average 
weight in dimension i is at most — | for infinitely many prefixes of 7r; hence, 
Ai(n) < — | < 0, and the claim follows. 

To conclude, if the intersection Bi~° n (PliLi Ai~°) is empty, then for every 
infinite path it, either Bi(tt) < or there exists some i £ {1, . . . , k} such that 
Ai(ir) < 0, which concludes the proof of Lemma [6] □ 

A. 4 Proofs for subsection 13.51 
Proof of Lemma \8\ 

Proof. To prove the first item of Lemma |S] we present a detailed description of 
the max- free constraints for an expression E and a threshold v. Let A be the 
fc-dimensional product automaton of the automata that occur in the expression 
E; w.l.o.g we assume that for some j, the first j dimensions of A correspond to 
the LimlnfAvg automata A\, . . . ,Aj, and the last k — j dimensions correspond 
to the LimSupAvg automata Aj+±, . . . , A^. Let f be a 2fc-dimensional vector of 
variables; let C be the set of all simple cycles in A; and we define a variable 
X l c for every cycle c in C and a dimension i £ {j + 1, . . . , fc}; then the min- 
only constraints for the expression E and the threshold vector (r±, . . . , r^) are 
as follows: 

^X l c wt m (c) > r m for every i £ {j + 1, . . . , fc}, m € {1, . . . ,j, i} (3) 

cec 

\c\X* = 1 for every i e {j + 1, . . . , k} (4) 
X l c > for every i G {j + 1, . . . , k}, and c e C (5) 
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and the max-free constraints are the min-only constraints along with the con- 
straints 

M E xr>K (6) 

where Me and b v are the 2k x 2k matrix and the 2fc-dimensional vector from 
Lemma [7] 

The proof of Lemma follows immediately from the definition of the 
max-free constraints. 

To prove the additional two items of the lemma, we observe that the max- 
free constraints for the expression E and the threshold v remain linear when the 
threshold v is a variable; hence, the problem of computing the maximum thresh- 
old v for which the max-free constraints are feasible amounts to the following 
linear-programming problem: 

Find the maximum v subject to the max-free constraints for expression 
E and threshold v. 

Let W be a bound on the absolute value of the weights of A; clearly the max-free 
constraints are feasible for the threshold — W, and are infeasible for the threshold 
+2W; hence, the domain of feasible thresholds is bounded and nonempty, and 
by standard properties of linear programming |16j . it follows that a maximum 
threshold exists. Moreover, we observe that every coefficient in the max-free 
constraints can be encoded by polynomial number of bits (as the length of a 
simple cycle in the product automaton is at most exponential in the size of the 
input), and that the number of constraints, which are not of the form of x > 0, 
is 0(k 2 ); we denote by D the maximal coefficient in the max-free constraints, 
by standard properties of linear programming |16j , it follows that the maximum 
value of v is obtained when at most 0(k 2 ) variables are assigned with rational 
nonzero values, and the result of the linear-programming (that is, the maximum 
threshold) is a rational with numerator and denominator bounded by D°( k ); 
therefore only 0(k 2 ) log(-D) bits are required to encode the maximum threshold. 

To conclude, we proved that for the maximum threshold v* for which the 
max-free constraints are feasible, there is a solution for the corresponding max- 
free constraints such that at most 0(k 2 ) variables are assigned with nonzero 
values; and the threshold v* requires only polynomial number of bits to encode; 
hence the last two items of Lemma [5] immediately follows. □ 

Proof of Lemma [9] 

Proof. Recall that we can decide the non-emptiness of a max-free expression 
by checking the feasibility of its corresponding max-free constraints, and that a 
rational solution for the max-free constraints corresponds to vectors of thresholds 
and a set of multi-cycles, each multi-cycle with an average weight that matches 
its corresponding threshold vector; by Lemma[8j2) the number of different simple 
cycles that occur in the witness multi-cycles set is at most t. We also observe 
that if a multi-set of cycles (that are not necessarily simple) with average weight 
vector v exists, then a v multi-cycle (of simple cycles) also exists, since we can 
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decompose every non-simple cycles to a set of simple cycles; thus, a V multi-cycle 
exists iff there exists a multi-set of short cycles, where the length of each cycle 
in the multi-set is at most the number of vertices in the graph (note that in 
particular, every simple cycle is short). 

Hence, we can decide the feasibility of the max- free constraints in the follow- 
ing way: First, we guess t weight vectors of t short cycles that occur in the same 
SCC of the product automaton of all the automata that occur in the expression; 
second, we construct the 0(k 2 ) constraints of the max- free constraints and as- 
sign zero values to all the variables of the non-chosen cycles; third, we check the 
feasibility of the formed 0(k 2 ) constraints, where each constraint has at most 
t + 1 variables. 

Note that we can easily perform the last two steps in polynomial time (as the 
values in the weight vector of every short cycle can be encoded by polynomial 
number of bits); hence, to prove the existence of a PSPACE algorithm, it is 
enough to show how to encode (and verify by a polynomial-space machine) t 
average weight vectors of t short cycles that belong to one SCC of the product 
automaton. 

The encoding technique is straight forward and standard; we present its de- 
tails only for the purpose of self-containment. We based the encoding on the 
observations that a vertex in the product automaton is a fc-tuple of states, and 
that a short cycle is characterized by: (a) its length, which is at most the size 
of the product automaton (that is, at most exponential in the size of the ex- 
pression); (b) its initial (and final) vertex (that is, a fc-tuple of states); and (c) a 
sequence of alphabet symbols that corresponds to the path from its initial vertex 
to its end vertex. 

Thus, we encode t average weights by the sequence 

(wx, . . . , w t )#(ax, bx, ci)#(a 2) b 2 , c 2 )# . . . #(a 4 , b t , c t )#7r 1 ^ 2 ^---^t^i 

where wi,...,Wf are the t average weights; ,bi and Ci are respectively the 
length, initial vertex and the path (that is, sequence of alphabet symbols) of 

the cycle with the weight u^; and tti^^ >t^i is a sequence of symbols that 

corresponds to a cyclic path between all the initial vertices of all t cycles. 

To verify the encoding, we simply simulate, in parallel, each of the k weighted 
automata, and store the weight vectors of each short cycle, which requires at 
most polynomial number of bitqj; we verify that all the cycles are in the same 

SCC, given the witness 7ri_>.2^ >t->i, in similar way; finally, all that is left is 

to verify that the vector (w\, . . . ,Wt) corresponds to the real average weights of 
the cycles; in addition, we reject the witness if its number of bits exceeds the (at 
most exponential) length threshold of £ 3 |»4|, where A is the product automaton 
of all the automata occur in the expression. 

To conclude, we proved that there is a PSPACE algorithm that decides the 
feasibly of the max- free constraints, and Lemma H] follows. □ 

2 Note that in general, the sum of exponential number of rationals may require ex- 
ponential number of bits; however, in our case, there are only \A\ different rational 
numbers, hence their lowest common denominator has only polynomial number of 
bits, and their sum can be encoded by polynomial number of bits. 
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Proof of Lemma 1101 

Proof. By definition, there exists an infinite word w such that E(w) > v iff 
the expression E is nonempty with respect to threshold v. By Lemma [HJ3) 
and by the equivalence of the feasibility of the max-free constraints and the 
emptiness of the expression, the maximum threshold for which the expression E 
is nonempty is a t-bits rational number (and moreover such maximum threshold 
exists) ; hence we can find this maximum threshold by checking the emptiness of 
E for all thresholds that are t-bits rational numbers, and return the maximal such 
threshold (possible optimization is to do binary search over all i-bits thresholds); 
this can be done in polynomial space due to Lemma [SI □ 

B Proofs for Section 0] 
B . 1 Proof of Theorem Q] 

Proof. First, we claim that if the number of max operators in the expression 
E is m > 0, then we can construct in linear time two expressions E\ and E2, 
each with at most m — 1 max operators and of size at most \E\, such that E = 
max(i?i, E%). We prove the claim by induction on the number of (any) operators 
in the expression: if the number of operators in the expression is zero, the claim 
is trivially satisfied; otherwise let E — op(F, G) such that the expression F has 
at least one max operator; as F has strictly fewer operators (as compared to E), 
by the inductive hypothesis there exist two expressions F± and F2, each with at 
most m— 1 max operators, and of length at most such that F = max(Fi, F 2 ); 
the reader can verify that E\ = op(i 7 i, G) and E2 = op(F 2 , G) satisfy the claim, 
that is, E = max(£i,£ 2 ) and \E X \, \E 2 \ < \E\. 

Second, we observe the fact that if E = max(-Ei, E2), then 

sup^^ E{w) = max(su Pu , eI> , sup weE ^ E 2 {w)) 

Hence, in order to compute the maximum value of E, we simply compute the 
maximum value of E\, the maximum value of E 2 and return the maximum of 
the two values. If E\ and E 2 are max-free expressions, then thanks to Lemma [TU1 
we can compute their maximum values by polynomial space Turing machine; in 
the general case, if the number of max operators in the expression E is m, then 
we construct in linear time two expressions E\ and E 2 , each with at most m — 1 
max operators, such that E = max(.Ei, -E2); then we recursively compute the 
maximum value of E\ and the maximum value of E 2 and return the maximum 
of these values. 

The reader can easily verify that the procedure we described requires only 
polynomial space to run, and thus the proof of Theorem [T] follows. □ 

B.2 Lower bounds 

In this subsection we will establish PSPACE lower bounds for the emptiness, uni- 
versality, language inclusion and language equivalence problems; we obtain the 
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PSPACE lower bound for the emptiness problem by a reduction from the empti- 
ness problem for intersection of regular languages (which is PSPACE-hard [E]); 
for the universality problem we obtain the bound by a reduction from the uni- 
versality problem for union of regular languages (which is the complement of 
the first problem, and hence, also PSPACE-hard); and the lower bounds for the 
language inclusion and equivalence problems are obtained by a reduction from 
the universality problem (of mean-payoff expressions) . 

To present the reduction from the emptiness problem for intersection of regu- 
lar languages we define, for a language of finite words LCT, and for a symbol 
£ ^ E, the following function, for every infinite word w G {S U {£})": 



v ' y — 1 otherwise 

It is easy to verify that if the language L is recognizable by a finite-state au- 
tomaton A, then we can construct in linear time a weighted automaton A 
such that A = f L ( A ^; and that for any k finite-state automata Ai,...,Ak 
over the alphabet S, the intersection |~)i=i L(Ai) is nonempty iff the expression 
E = min(.Ai , . . . , Ak) is nonempty with respect to threshold and alphabet 
£ U {£}; thus, the emptiness problem for mean-payoff expressions is PSPACE- 
hard. 

We prove the PSPACE hardness of the universality problem in a similar way; 
we define the next function for every infinite word w G (ru{(})": 



(w) = l +l if W E S " 
\ — 1 otherwise 

we denote by G the (minimal) weighted automaton for which G(w) = g (surely, 
such automaton exists); and we observe that the union of the regular languages 
Ui=i L(Ai) is universal iff the expression E = max(.4i, . . . , Ak , G) is universal 
with respect to threshold and alphabet S U {£} (recall that Ai = f L< - Ai ^). 
Thus, the universality problem for mean-payoff expressions is PSPACE-hard. 

The reductions from the universality problem to the language inclusion and 
equivalence problems are trivial; let Z denote a weighted automaton for which 
Z_{w) = (for example an automaton where all the weights of the edges are zero, 
and let Eq denote Z_; then the expression E is universal with respect to threshold 
iff E > Eq, and iff the expression min(i?, Eq) is equivalent to the expression 
Eo. Since the universality problem is PSPACE-hard even for threshold 0, the 
next lemma follows. 

Lemma 12 For the class of mean-payoff automaton expressions, the quantita- 
tive emptiness, universality, language inclusion, and equivalence problems are 
PSPACE-hard. 



